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Abstract 

In this paper we introduce a three replica potential useful to examine the structure of metastable states 
above the static transition temperature T c , in the spherical p-spin model. Studying the minima of the 
potential we are able to find which is the distance between the nearest equilibrium and local equilibrium 
states, obtaining in this way information on the dynamics of the system. Furthermore, the analysis 
of the potential at the dynamical transition temperature T d suggests that equilibrium states are not 
randomly distributed in the phase space. 



1. Introduction. 



In these years it has been realized that there are model systems for which the dynamics 
can be analytically studied in the infinite volume limit. In some of these systems, below a 
characteristic temperature Tj, called dynamical transition temperature, the phase space 
of the equilibrium configurations breaks down in regions (from here on valleys) where 
the system is trapped for an infinite time. Therefore, in this situation, if the system is 
near an equilibrium configuration at the initial time, it will remain in this region forever. 
The number of these regions is exponentially high as soon as T > T c , where T c < T d 
is the static transition temperature, at which only a finite number of valley starts to 
dominate the partition function; these features are clearly revealed by an analysis based 
on the TAP equations [1,2,3]. All the equilibrium valleys are characterized by the same 
energy density E, entropy density S v and self-overlap qea- The total entropy density 
of the system will be given by 



where E is the so called configurational entropy or complexity, i.e. E = (1/AT) lnjV, 
where M is the exponentially high number of valleys and N is the size of the system. 
The complexity goes to zero at the transition temperature T c . 

It is also true that in the region T < Td, if the system starts randomly at the initial 
time, the energy of the system evolves toward a value greater than the equilibrium one 
[2,4]. In other words, metastable states are present. In the rest of the paper these 
metastable states will be also called local equilibrium state, while the name equilibrium 
states will be reserved to valleys which have the correct equilibrium energy density. 

It is clear that these features, especially the last one, are likely to be an artefact of the 
mean field approximation, which is correct in these models. It is therefore interesting to 
try to understand what happens when corrections to the mean field theory are present. 
The simplest case we can think about is when N is finite and large: the times to escape 
from a valley are likely to be exponentially high in N. The direct computation of these 
exponentially large times using the dynamical equations is rather involved and it has 
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not been done. A partial solution to the problem consists in assuming the dynamics is 
dominated at ultra large times by the crossing of free energy barriers between different 
valleys and some information can thus be gathered by computing these barriers and by 
the analysis of the mutual disposition of metastable states. 

This program cannot be pursued directly with the usual tools of statistical mechanics 
and we must resort to use a different method, the real replica method [2,5], in which 
two or more (in general M) real replicas are introduced. If we denote by q the M x M 
matrix of the overlaps imposed among the different real replicas 



detailed information on the free energy landscape is carried by the free energy as function 
of q. This program is quite recent. Up to this moment only the case M = 2 has been 
examinated in details. In this case one computes a two replica potential ^2(^12), which 
is the free energy of replica 2 constrained to have overlap q±2 with replica 1, supposed 
to stay at equilibrium [5]. A different potential ^12(912) can be introduced, defined as 
the free energy increase of a pair of two replicas if we constrain them to stay at mutual 
overlap qi2 [2]. The main difference among these two cases is the following: 
In the first case replica 1 is at equilibrium and replica 2 is not, because it must satisfy 
a constraint; obviously for some particular values of qi2 (e.g. qi2 = 0) the constraint is 
harmless and also replica 2 is at equilibrium. In the second case replica 1 and 2 are chosen 
in such a way to satisfy a constraint and both will be in general out of equilibrium. The 
first construction is the most appropriate one if we want to get information on the free 
energy landscape around an equilibrium configuration. The relevant computations have 
been already done and they will be summarized here for reader convenience. From this 
two replica potential one can compute the dynamical transition and the configurational 
entropy, and obtain a first estimate of the barriers separating different valleys. 

The question we address in this paper is the organization of equilibrium and local 
equilibrium states. For example, given a generic equilibrium configuration we would like 
to know which is the maximum overlap q at which is found a local equilibrium state. 




(1.2) 
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In the same fashion we would like to know which is the maximum overlap q* at which 
is found an equilibrium state. It is not evident a priori if q 7^ q* (which is the result we 
find) or not. 

In order to answer to this and other questions we need to consider a three replica 
potential ^((712,(713,(723), which is the free energy of replica 3 constrained to stay at 
overlap (713 and ^23 from replica 1 and replica 2 respectively, where replica 1 is an 
equilibrium configuration and replica 2 is constrained to stay at distance qi2 from replica 
1. This potential is useful to explore in more detail the free energy landscape with 
respect to the previous case where only two replicas are present. The stationary points 
of this potential correspond to local equilibrium states of the system. 

In this paper we devote our attention to the p-spin spherical model, due to its sim- 
plicity and to the relatively simple form of the free energy. Similar considerations can 
be applied also to other models, but this will not be done in this paper. In Sect. 2 
we recall for reader convenience the definition of the p-spin spherical model and the 
computation of the two replica potential. In Sect. 3 we present the computation for 
the three replica potential. The shape of the potential and its stationary points, which 
correspond to local equilibrium states, are computed in Sect. 4. In Sect. 5 we study 
the temperature dependence of the various quantities involved. Finally, in Sect. 6 we 
discuss some of the implications of our finding for the dynamics of the system at large 
volume. Two appendices contain the more technical aspects of the computations. 
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2. The two replica potential. 



Let us introduce the p-spin spherical model [6,7,8,9], denned by the Hamiltonian 

H ( a ) = ^2 J ii-i P a ii ■ ■ - a i P 

* 1 « a <...< ip {21) 

i 

where the Oi are real variables satisfying the spherical constraint; the couplings Ji 1 ...i p 
are independent Gaussian variables with variance 

pi 



/2 _ (o 2) 

u n...i p 2Np~ 1 ' ' 

With these definitions 

WWW) = ^/(w) = N l -ql a , , (2.3) 

where q aa > is the overlap between the two configurations (see eq. (1.2)). We note that it 
is possible a generalization to random Hamiltonian models, specified by different forms 
of the correlation function / [10,11]. 

Following [5] we consider the two replica potential ^(912), defined as the free energy 
cost to keep a configuration r (replica 2) at a fixed overlap q±2 with an equilibrium 
configuration a (replica 1): 



-pNV 2 (q 12 ) = -(3N(F flxed - F free ) = 



J daexp(-(3H(a)) log (^J dr exp(-pH(r)) 5(q aT - q 12 ^j - log Z free . (2.4) 

It is important to note that in this way we compute the free energy only of the second 
replica r, while we operate an annealed average over a. Indeed, this can be done by 
virtue of the assumption that the constrained free energy Ffi xe d is self-averaging with 
respect to a. To perform the average on the quenched disorder, we use the replica trick: 



lim — log / da a dTb exp 



-(3NV 2 (q 12 ) 



Kd=l 6=1 



11 %m - 

(2.5) 



6=1 



- log Z free . 

We introduce the overlap sub-matrices 

Qll = QvaVb a = 1, . . . , n; b = 1, . . . , n 

Qll = <lvaT h a = 1, . . . , n; b = 1, . . . , m (2.6) 

Qll = Qr a r b a = 1, . . . , m; 6 = 1, . . . , m ; 
and the total matrix of the overlap Q, formed by the blocks (2.6). With this definition, 
equation (2.5) gives 

-pV 2 (q 12 ) = Jhn o ^ ^ 2 fiQab) + logdet Q j + (3F free . (2.7) 

Before proceeding with the calculation, it is necessary to give sensible ansatz for the 
overlap sub-matrices. From now on we will consider only temperatures T greater than 
T c and zero external magnetic field; therefore, since Q 11 is referred to an independent 
free system, we assume for it the symmetric form 

Qll = ^b ■ (2.8) 

The structure of Q 12 is in part imposed by the constraint in (2.5), that forces the first 
row to be equal to q\ 2 - The simplest ansatz for the whole matrix is 

Qll = Q12 S a ,i ■ (2.9) 

This choice is confirmed by the analysis of the potential in the limit 1 f3 — > 0; moreover, 
if we introduce an additional parameter w\ 2 for the rest of the matrix, the saddle point 
equations lead to the solution w 12 = 0. 



1 At (3=0 the calculation reduces to a purely geometrical problem; indeed, in this case the potential 
is simply proportional to the volume of the phase space region accessible to the constrained replica. 
Therefore, the comparison with this limit is crucial to test the ansatz for the overlap matrices. 
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In [5] Q 22 was assumed symmetric, but a successive examination suggested that a 
more general one step RSB form has to be taken [12], with variational parameters 

(x r ,ri,r ): 

Qll = (1 - ri )5 ab + (n - r )e ab + r Q , (2.10) 

where e a b is equal to one in the diagonal blocks of size x r and zero elsewhere. 
With these assumptions we obtain (see Appendix A for details): 

-2pV 2 (q 12 ) = 2(3 2 f(q 12 ) + (3 2 (x r - l)/(n) - (3 2 x r f(r ) 

,1/1 \ , 1 1 fi , r i ~ r o\ r — qr? 2 ( 2>11 ) 

+ log(l-ri)H log [l + x r - + 



x r V 1-ri/ 1 - n + x r (ri - ro) 

The parameters with respect to which the potential has to be maximized are (x r , r\,ro) 
and the saddle point equations read: 



(1 - x r )/3 / (n) = (1 - x r ) Tj ■ 7 rr^ ri - g 12 + x r 



(1 - ri + x r (ri - r )) 2 \ " 1 - r\ 



x r (3 2 f(r ) = x r (r ° 9?2) 



(1 - n + x r (r x - r )y 
/3 2 /(ri) - (3 2 f(r ) = -I log fl + x r ^^ 



V 1 — ri 



1 1 - ri +a r (n -2r + Ql 2 2 ) 

— ^1 - r j — 7- ■ -. tt 

x r (1 - n + x r (ri - r )) 



2 



(2.12) 

Setting r = ri we obviously recover the replica symmetric expressions given in [5]. 

The RSB ansatz for Q 22 slightly modifies the shape of the potential V 2 (see Fig. 
1) eliminating the secondary minimum found in [5], the interpretation of which was 
unclear. For the rest, all the features of the potential remain the same: there is an 
absolute minimum for qi2 = with Vi = 0, which represents a typical equilibrium 
configuration of the second replica r; moreover for T <Ta there is a relative minimum 
M for qi2 = qEA corresponding to the situation in which r is in the same pure state 
as the first replica a. We note that in this second situation, the configuration r is of 
equilibrium but not typical, in the sense that, for entropic reasons, if the system were 
not constrained, it would be very unlikely to find r in the same pure state of a. It turns 



out that the value of the potential in M gives information on the number of dominant 
pure states, i.e. 

V 2 (q EA )=TE, (2.13) 



where E is the configurational entropy [5]. 




qi2 

Fig. 1: The potential V 2 at /3=1.64 and p=3; g E A=0.546. 



3. The three replica potential. 

As we have seen, the analysis of V 2 gives information on the self-overlap and on the 
number of the states dominating at a certain temperature. It remains rather unclear 
how the phase space is organized in terms of these states; in other words, we would 
like to know more about their mutual overlaps, and study the evolution of the whole 
structure with the temperature. 

A natural generalization of the method that leads to V 2 , consists in considering three 
different real replicas, constrained to have fixed mutual overlap, as we are going to 
explain. As in the case of V2, we take a first independent replica p which thermalizes 
freely at a temperature T. We then consider a second replica a constrained to thermalize 
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at a fixed overlap qi2 with p. Finally, we calculate the free energy of a third replica 
r constrained to have overlap qis with p and 923 with a. In this way it is possible to 
define a three replica potential V 3 , taking the difference between the constrained free 
energy of r and the free energy of the unconstrained system: 

-/3An/ 3 (gi2,<?i 3 ,<?23) = 



1 



' free 



dpeM-PH(p)) 



1 



Z(p;qi2) 



daexp(-pH(a)) 5(q pa - q 12 )x 



log J dTexp(-(3H(r)) 5(q pT - q 13 ) 5(q aT - 923) - logZ /ree , 



(3.1) 



with 



Z{p; qi2) = J da exp(-/3tf (a)) 5(q pa - q 12 ) . (3.2) 

In our analysis we limit ourselves to the situation in which the temperatures are the 
same for the three replicas. Our purpose is to study the potential V3 in the plane 
(?13) Q23) at various fixed values of qw In this way, through the position of replica 3, we 
can explore the neighborhood of replica 2, which is not a configuration of equilibrium 
for the free system; this is possible because of the different role of the first and second 
replica. By the usual trick we get 

-^1^3(912,913,923) = 

1 



lim - log / dp a d(7bdT c exp 

n,m,l— >0 I 



V a=l 



6=1 



c=l 



X 



I 



(3.3) 



II 6 (<lpi° b - 912) II 6 ^Pir c - Ql3)8(q* lTc - Q23) - logZ/r 
6=1 c=l 

Again we introduce the sub-matrices: 



Qll = 


IpaPb 


a = 


1,.. 


.,n; 6=1,. 


.,71 


Qll = 


1Pa°b 


a = 


1,.. 


.,n; 6=1,. 


. . , m 


n 22 - 




a = 


1,- 


. , m; 6=1, 


. . , m 


Qab 


QpaTb 


a = 


1,.. 


.,n; 6=1,. 


.,/ 


Va6 — 


1<y a T b 


a = 


1,.. 


. , m; 6=1,. 


..,/ 




1r a T b 


a = 


1,.. 

9 - 


.,/; 6=1,.. 


.,/; 



(3.4) 



and the total overlap matrix Q. In analogy with the case of V2, the expression of V3 in 
terms of Q after averaging over the disorder, is 

-^3(912,913,923) = I™ ^ \ /3 2 V/(Q a6 ) + logdetQ + f3F free . (3.5) 

\ a,b J 

It is important to bear in mind the difference between the roles of replicas 1 and 2, 
which is encoded in the different form of the relative overlap matrices. Q 11 refers to 
the first free replica, while Q 22 refers to replica 2, which thermalizes at fixed overlap 
qi2 with 1. Both replicas are however independent from the third one, so the form of 
Q , Q 12 and Q 22 is identical to the one assumed in the case of V<i and the value of 
the variational parameters (x r ,ri,ro), which are function of (/12, are determined by the 
same equations (2.12). 

In second place, Q 33 is assumed one step RSB, with parameters (x s , si, so): 

Qf b = (1 - si)$ab + (si - s )e a b + sq ; (3.6) 

there is no reason to set x s = x r , since just as Q 22 is broken independently from Q 11 , 
the breakings of Q 22 and Q 33 have to be assumed independent; moreover, there are no 
algebraic motivations for this equality. 

For what concerns Q 13 , the limit (3 — > shows that it is correct to assume a form 
similar to Q 12 , 

Qll = 913 S aA . (3.7) 

However, the same limit shows that this form is no longer valid for Q 23 ; namely, the 
first row will still be equal to ^23 , but the rest of the matrix no more can be set equal to 
zero. Moreover, the structure of Q 23 has to take into account the RSB form of Q 22 : if 
replicas 2 are organized into clusters, it can be that the overlap of 3 with the particular 
cluster that contains the first replica o\ of 2 (this is the only replica of 2 really coupled 
to 3, as shown in (3.3)) is different from the overlap of 3 with any other cluster. 

Therefore, we postulate a RSB form also for Q 23 . This is possible if we break the 
symmetry in the rows of Q 23 in the following way: 

Qfb = (923 - W 2 3)5 aA + (W 23 ~ Z 2 3)e a ,l + ?23 ■ (3.8) 



This one step RSB needs a breaking point x, but the genesis of the breaking shows 
clearly that for Q 23 it has to be taken as breaking point x r , that is the same of Q 22 . 
In conclusion, the new variational parameters are: 

X S ,S 1 ,S ,W 2 3,Z2S • (3.9) 

With these ansatz, the expression of V3 is (see Appendix B for details) 
-2(lV 3 (q 12 , q 13 , 923) = 2[3 2 f(q 13 ) + 2[3 2 f(q 23 ) + 2[3 2 (x r - l)f(w 23 ) - 2[3 2 x r f(z 23 ) 
+ (3 2 (x s -l)f( Sl )-(3 2 x s f(s ) 
+ log(l - si) H log l + x a - + 



x. 



1 - St J 1 - Si + x s (si - s ) 

(3.10) 



with 

,2 , / ... \2 



V = Qi3+(Q23 - w 23 ) (a + b + c) + 2(q 23 - w 23 )(w 23 - z 23 )(a + x r (b + c)) 

+2(923 - w 23 ){z 23 - qi 2 qi 3 )(a + bx r ) + (w 23 - z 23 ) 2 x r (a + x r (b + c)) (3.11) 
+2(w 23 - z 23 )(z 23 - qi 2 qi 3 )x r (a + bx r ) , 



and 



1 

a = 



1 — T\ 

n - r 1 

6 = ~1 1 T 7 V 3.12 

1 — r\ 1 — ri + x r [r\ — ro) v 7 



(1 - n + x r (ri - r )) 2 
Expression (3.10) is very similar to the one of 1^2(912) with (x s , si, so) playing the role 
of (x r ,ri,ro) and y instead of q\ 2 . Indeed, the saddle point equations for (x s ,si,so) 
are in form exactly identical to (2.12), changing q\ 2 into y. Moreover, V3 has to be 
maximized with respect to 1^23 and 223: 

(1 - x r )(3 2 f'(w 23 ) = (1 - x r ) - — ^ z[(q 2 3-w 23 )(b + c) 

1 - Si + X s {Si - So) 

+ (^23 - z 23 ){a + x r {b + c)) + (z 23 - 912913) (a + bx r )} 

x r (3 2 f'(z 23 ) = x r - —^— t r[(923 - w 23 )c 

1 - Si + X S {S\ - s ) 

+ x r {w 23 - z 23 )c + (z 23 - 912913) (a + bx r )} . 

(3.13) 



We note that the equations for (x s , s\, so) are coupled to equations (3.13) by means of 
y, that contains W23 and Z23. 

Let us now examine under which conditions the case of V2 is recovered. It turns out 
that 

V3(«?i2 = 0, q 13 = 0, Q23) =^2(^23) 

(3.14) 

V 3 (qi2 = 0, <?i3,<?23 = 0) =1^2(913) • 
This is just what we expected for the following reason: setting qi 2 = replica 2 ther- 
malizes as in the free case and so replica 1 and 2 are both equilibrium configurations. 
In this situation, if we set, for example, q±3 = 0, the constraint 1-3 is harmless and the 
pair 2-3 reproduces the case of V2 ; the same is true for q 2 3 = 0. 



4. The shape of the potential. 

The most important information in the study of V3 comes from the analysis of its 
minima in the plane (1713,523) at fixed values of (/12, which correspond to stable or 
metastable states of the system. We then minimize V3 with respect of q±3 and 523: 

/3 2 /'0?i3) =z — *-t r[<?i3 - <?12(<?23 - w 23 )(a + bx r ) 

1 - Si + X 8 {Si - s ) 

-qi2(w 2 3 - z 23 )x r {a + bx r )\ 

1 (4-1) 

P 2 f '(Q23) =~ ■ - f r [(?23 - w 23 ) (a + b + c) 

I-81 + Xs(Sl ~ So) 
+ (W 2 3 ~ Z23)(a + X r {b + C)) + (Z23 ~ ?12?13)(a + bx r )} . 

First of all, we note that for each value of qi 2 there is a solution of (4.1) for g 13 = q 2 3 = 0, 
with V3 = 0. This is the absolute minimum of the potential in the ((/i3,(/23) plane and 
corresponds to the situation in which the third replica sees a phase space identical to 
that of the unconstrained system 2 . 



2 

The requirement that replica 3 is sited somewhere in the phase space, translates into the formula: 
J dq 13 dq 2 3e~ NV 3( qi3 ' q23 ^ =1 Vqi2, and for N^oo this implies that in the absolute minimum the poten- 
tial has to be zero, as it is in our case. 



For what concerns non trivial minima, the numerical analysis of equations (4.1) in 
the case p = 3, shows the following pattern: 

i) For any value of qi2 and for any temperature in the range (T c ,Trf), we find a 
minimum M\ with 

<7i3 = Qea 

<?23 ~ <?12 (4.2) 

V 3 (M 1 ) = V 2 (q EA ) . 

The interpretation of Mi is very simple: the third replica is in the same pure state of 
the first one, independently from the value of q^; Mi has exactly the same meaning of 
M for the two replica potential. As q±2 grows, the second replica approaches this state, 
not changing the potential, until for q\2 = qEA the three replicas are all in the same 
state and qi2 = qi3 = q 2 3 = Qea- We call this point O. 

It is important to note that (723 = qi2 holds only in three points (see Fig. 2). Obviously 
it happens for qi 2 = 0. Then, as q±2 grows, we have q± 2 > 523 and this holds until 
Q12 = Qmaxj where g max is the value for which V 2 has its maximum; here again qi 2 = q 2 3- 
For qmax < qi2 < qEA we have the opposite situation, with qi 2 < ^23, until we reach Q. 

This behaviour is consistent with the idea that at a distance q m ax from the state 
of replica 1 the free energy reaches a maximum; the interpretation of Fig. 2 is then 
the following: Replicas 1 and 3 are in the same state but they have not the same 
role: replica 1 is some quenched typical configuration of the state, while, in some sense, 
replica 3 represents the center of the state, because of the thermodynamic average. 
When qi2 < q m ax, replica 2 reaches its minimum energy taking the maximum distance 
from the center of the state, compatibly with the given value of q±2, and in so doing ^23 
results lower than gi 2 . The opposite situation holds when q 12 > q m ax- 



13- 



923 




Fig. 2: 523 in Mi as a function of q 12 at ,3=1.64; g max =0.361, <?eA=0.546. 

ii) More interesting is the presence of a minimum with the third replica close to the 
second one. For T in the usual range (T c , T d ) and < qi 2 < q(T) we find a minimum 
M 2 with 



<?23 ~ QEA 

qi3 ~ qi2 < qEA ■ 



(4.3) 



It is important to note that the last value q of q± 2 for which M 2 exists is at any tem- 
perature less or equal to qEA- 



923 0.5 



0.05 0.1 0.15 0.2 0.25 0.3 0.35 0.4 

912 

Fig. 3a: 923 in M 2 as a function of q 12 at /3=1.64; <j B a=0.546, <J=0.385. 
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Fig. 3b: The energy difference AE in M 2 as a function of q 12 at (3=1.64; <j*=0.295, g=0.385. 
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Fig. 3c: The potential V 3 in M 2 as a function of q 12 at /3=1.64; <j*=0.295, g=0.385. 

Let us fix a reference temperature T and examine M 2 at different values of q\ 2 . For 
<7i2 = we have q\z = 0, ^23 = Qea and Vs(M 2 ) = V^sa); this is trivial because we 
have seen that in this case V 3 reduces to V 2 . When q 12 ^0 we force the second replica 
to thermalize in a restricted portion of the phase space; the fact that we still find the 
minimum M 2 corresponding to the third replica in equilibrium close to the second one, 
shows that there are local equilibrium states even at non zero overlap qi 2 with the state 
of the first free replica. The variation with qi 2 of the interesting quantities evaluated in 
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M 2 is shown in Fig. 3. 

We note that q 2 3 remains close to qEA, confirming the hypothesis that the second 
and the third replica are in the same state. It is then crucial to verify if the states 
corresponding to the minima M 2 can be identified with TAP solutions, i.e. if their free 
energy and self-overlap satisfy the TAP equations. First, at fixed 512, the self-overlap 
of the state relative to M 2 is given by s\ (see eq.(3.6)). Secondly, we must compute the 
free energy of this particular state; to this end we can write 

V 3 (M 2 ) = (/ 3 - TE 3 ) - F free , (4.4) 

where / 3 is the free energy of the state in which replica 3 thermalizes, and £3 is the 
logarithm of the number of states accessible to replica 3, compatibly with the constraints; 
obviously, since replica 3 is in the same state of replica 2, which is fixed, we have £3 = 
and therefore 

f 3 = V 3 (M 2 ) + F free . (4.5) 

It turns out that in M 2 the relation holding between ^3 and s\ is always the same of 
the TAP approach [2]. In other words, the state corresponding to M 2 coincides with 
that particular TAP solution specified by 

Jtap = h 

(4.6) 

qTAP = Si . 

Let us now consider the behaviour in M 2 of the energy difference AE = E — Ef ree : 
we note that there is a value q\ 2 = q* for which 

AE(q*) = . (4.7) 

The fact that in this minimum the energy is equal to the one of the unconstrained 
system means that replicas 2 and 3 are in a state of the same kind of the one chosen by 
the unconstrained system, that is one of the TAP solutions dominating the equilibrium; 
indeed, we have si(q*) = qEA (the same happens in the minimum M of V 2 ). For this 
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reason, the valley entropic contribution S v to V3 is the same as in the free case (see 
eq.(l.l)). Thus we expect 

V 3 (q*) = TZ = V 2 (q EA ) , (4.8) 

that is what we find (see Fig. 3c). 

Therefore, we have the following picture: at temperature T with T c < T < T d: there 
is an exponentially high number of equilibrium states partitioning the phase space and 
the first unconstrained replica will thermalize into one of them, call it K. From our 
discussion follows that the closest states of the same kind and with the same energy 
density of K, are found at overlap q* with K. Moreover, the fact that the last minimum 
M 2 is found at qi2 = <?, shows that at smaller distances there are local equilibrium states 
with higher energy density, the closest of which have overlap q with K. 



5. Temperature dependence. 

Up to this moment we have studied V3 at fixed temperature; now we examine the 
evolution of the system with T, in particular in the two limits T — > T c and T — > Td- 

At T c the configurational entropy E of the dominant equilibrium states goes to zero 
[2,3]; this means that the number of these states becomes of order N and they all have 
zero overlap with each other. In this situation we expect that, fixed an equilibrium 
state, the closest one is at overlap zero; indeed, we find that q* — > for T — > T c . On 
the other side, at T c the equilibrium states have the lowest energy density [2,3], while 
there is an exponentially high number of local equilibrium states with higher energy; 
according to this we find a non zero value of q even at T c . 

What happens at T d is more interesting. First, we know that at this temperature 
the equilibrium states have the highest energy density, so we expect not to find local 
equilibrium states at higher energy; this is exactly what we have, since q — > q* for 
T — > Td- Moreover, at this temperature S reaches a finite value, meaning that the 



number of the equilibrium states is still exponentially high; therefore, it is not clear a 
priori what is their minimum mutual distance. The very interesting feature shown by 
our potential is that 

q,q*^q d for T -> T d , (5.1) 

where q d is the value of qEA at the dynamical transition. Equation (5.1) means that as 
T approaches T d , the closest equilibrium states collapse into a single state of self-overlap 
q d - 

More precisely, for T ~ T d and p = 3, we find 

q E A={T d -T) 1 / 2 + q d , q d = 0.5 

(5.2) 

(f = a(T d -T) b + C . 
A fit of the numerical data gives 

a = -1.2 

6 = 0.24 (5.3) 
c = 0.5004 . 

As we have seen, this indicates that q* reaches q d at T d . The value of the exponent 6 
can be less firmly established; indeed, if we make a fit fixing c = 0.5 we get 

6 = 0.30. (5.4) 

Finally, we can study the potential for T > T d . In this range the dominant equilibrium 
state is the paramagnetic one and the two replica potential has just the minimum in 
zero; for this reason the minimum Mi of V3 disappears, and do not exist other minima 
with AE = 0. However we still find the minimum M2 in a restricted range of q\i 
(see Fig. 4), to point out the existence of local equilibrium states even at temperature 
greater than T d: corresponding to TAP solutions surviving above T d . This situation 
holds up to a temperature Ti ast > T d over which all non trivial minima disappear. For 
p = 3 we have 

0c = 1.706 

d = 1.633 (5.5) 
0i a8t = 1.573 . 



With regard to this see also [13]. 




6. Open questions and hints on the dynamics. 

Let us summarize some of our findings which are relevant for studying the dynamics. 
Near each equilibrium valley there are local equilibrium states with energy density 
greater that the equilibrium one. These local equilibrium states do exist up to a value 
q of the overlap, while the nearest equilibrium states are found at overlap q*. At the 
dynamical transition the three values q, q* and qa merge. 

The most surprising consequence of this picture is that the equilibrium states are not 
uncorrelated, i.e. they are not distributed randomly on the sphere, which would be the 
simplest possibility. Indeed, if they were randomly distributed, the nearest ones would 
be always at an overlap q, given by 

-t 1 -^)-^' (<u) 

which should remain definitively different from qd when T — > Td, since S(T^) has a finite 
value. 
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It seems that the equilibrium valley, that at has a flat direction (the replicon 
eigenvalue is zero), bifurcates in a bunch of not too different valleys below T^, like in 
the SK model. However, the organization of equilibrium states is not the same as in the 
SK model, because it shows up only when we add a constraint to the system. It may 
be possible, as suggested in [14] , that this situation may be in some way described by a 
non-monotonous function q(x), as for example the one found in [2,15]. 

We can now ask what happens to a configuration starting at time zero near an equi- 
librium one. In particular we are interested to compute the typical behaviour of the 
overlap q(t) among the configuration at time zero and the configuration at time t. It 
is natural to suppose that the form of the function q(t) will be typical of a punctuated 
equilibrium: exponentially long period of stasis, where q(t) fluctuates around a value 
that corresponds to a local equilibrium state, punctuated with fast variations of q(t), 
which correspond to jumps between one local equilibrium and other local equilibrium 
states. 

According to the previous picture the following scenario is rather likely. After a short 
transient time q(t) will go to a value equal to the self-overlap of the valley, i.e. qEA- 
After some exponentially large time it will jump to one of the nearest equilibrium states. 
If the barriers increase with increasing the distance (and therefore with decreasing the 
overlap) the most likely situation consists of a jumping to a local equilibrium state with 
overlap q. 

What happens at later times is not clear. If the different local equilibrium states are 
not correlated among themselves, (many replica potential is needed to investigate this 
point further), the system will return to the original state after some exponentially large 
time. Only after many attempts the system will jump to another equilibrium state at 
distance q* . At this point the system will not likely jump back and it will start from 
this point to do further jumps. 

The scenario we have presented here seems to be the simplest one compatible with 
our finding on the three replica potential. In a future paper we plan to compare this 
proposal with numerical simulations. It would also be interesting to study the problem 
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in the Random Energy Model, where many detailed computations can be done. 
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Appendix A. 

In this appendix we calculate explicitly the final form of the potential V^gi^)- We 
have: 

-PV 2 (q 12 ) = lim J- f/3 2 V/(Q a& )+logdetQ + (3F free . (A.l) 

n,m— *-0 Zm \ — ' / 
\ a, b J 

This expression has to be computed according to the particular form assumed for the 
overlap matrix. The first part is 

lim V^/(Q at ) = 

ab 

W 2 f{qi2) + P 2 f(l) + P 2 (x r - l)/(n) - P 2 x r f(r ) . (A.2) 

The second part is the most complicated one. It is useful to exploit the following 
relation: 

logdetQ = logdetg 11 +logdet(Q 22 -Q 21 (g 11 )- 1 g 12 ) , (A.3) 
where Q 21 stands for (Q 12 ) T . With our ansatz, from (2.8) and (2.9) 

logdetQ n = 0, (A.4) 

and 

Q 2 \Q XX )- X Q X2 = &, (A.5) 



is a constant matrix. In this way equation (A. 3) becomes 

log det Q = log detR , (A.6) 

with 

Rab = Qll ~ q 2 12 = (1 - ri)5 ab + (n - r )e ab + (r - q{ 2 ) . (A.7) 
To calculate the determinant of R we need to solve the eigenvalue equation 

(1 - n)v a + (ri - r ) e a6^6 + (r - 9? 2 ) XI Vfe = ' ( A ' 8 ) 

b b 

Let us distinguish three cases: 

i) If 

J2 e ^b = V a, (A.9) 

6 

and, consequently, 

$>6 = 0, (A.10) 

we have 

Ai = (l-n). (A.11) 

In (A.9) the number of independent equations is equal to the number of blocks, that is 
m/x r ; the degeneration of the previous eigenvalue is then 

d\ = m — m/x r . (A. 12) 

ii) If 

5>6 = 0, (A.13) 

b 

we obtain: 

A 2 = (l-ri) + x r (n-r ) , (A.14) 

because the elements of the vector v must be equal in blocks of size x r . The number of 
equations determining \ 2 is one and thus we have 

d,2 = m — (m — m/x r ) — 1 = m/x r — 1 . (A. 15) 
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iii) If the previous conditions are not satisfied, and the sums are all different from zero 
equation (A. 8) gives 



A 3 = (I - n) + x r (ri - r ) + m(r - qf 2 ) , 



(A.16) 



d 3 = l, 



(A.17) 



Expression (A. 6) then becomes 

— logdet-R = log(l — ri)+— log (l + x r — — — 
m x r \ 1 — r\ 

+ - log fl + ™i T±Z 4 l > (A.I8) 

m \ 1 — ri + x r (ri — r ) / m->0 

log I - n)+— log 1 + x r - + ■ . 

x r \ 1-riJ 1 — ri + x r (ri — ro) 

From (A. 2) and (A. 18) we get the final form 

-2(3V 2 (q 12 ) = 2(3 2 f(q 12 ) + (3 2 (x r - l)/(n) - (3 2 x r f(r ) 

+ log(l -n) + — log l + av- +- ■ ? . 

x r \ 1-nJ 1 — ri + x r (ri — r ) 



For the sake of completeness we note that there is a different method by which 
computing the potential, based on the formula 

-PNV 2 (q 12 ) = 



lim lim — -J— 



(icx exp 



dr exp(-/3H(T))6(q aT - q 12 ) 



R-V 



- log Z/ ree , 

(A.20) 

where in the calculation of the average R has to be considered as an integer (compare 
with eq. (2.5)). In this way the replicated partition function takes the form 



exp 



n R 



\a=l r=l 



R 



n n *( T « T « r - ««) ' ( a - 21 ) 



where we set a a = t*. With this approach we obtain a nR x ni? global overlap matrix 
Q, formed by the n x n sub-matrices Q r ^ h with a, 6 = 1, . . . , n; r, s = 1, . . . , R. In this 
way, the matrix Q 11 encodes the overlap 1-1, the matrices Q lr the overlap 1-2 and the 
matrices Q rs with r,s^l encode the overlap 2-2. The ansatz that has to be taken for 
the various matrices is a mere translation in this context of the one exposed in Sect. 2. 

The same line of reasoning can be applied in the computation of the three replica 
potential. Obvioulsy, in both cases, the two methods are equivalent. 



Appendix B. 

In this appendix we calculate the final form of the potential V3. We have: 

-^3(912,913,923) = lim hi^Y^ f(Qab) + log det Q I + (3F free . (B.l) 

\ a,b ) 

The first part is 

lim y/3 2 V f(Qab) =2(3 2 f(q 13 ) + 2/3 2 /(92 3 ) + 2(3 2 (x r - l)f(w 23 ) - 2(3 2 x r f(z 23 ) 

ab 

+ P 2 f(l) + [3 2 (x s - l)f( Sl ) - P 2 x s f(s ) . 

(B.2) 

For the second part we use the following relation: 

log det Q = 
= log det Q 11 

+ logdet[Q 22 -Q 21 (Q 11 )- 1 Q 12 ] 
+ logdet[Q 33 -Q 31 (Q 11 )- 1 Q 13 

- (Q 23 - Q^iQ'Y'Q'YiQ 22 - Q 21 ^ 11 )- 1 ^ 12 )- 1 ^ 23 - Q 21 (<5 n ) _1 <5 13 )] , 

(B.3) 

where we adopted the previous notation for the transposed matrices. The first two parts 
in the r.h.s reproduce the case of the two replicas potential and both go to zero when 
(n, m, /) — > 0. 
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The remaining parts of the determinant are: 

Q 31 (Q ll ) -l Q 13 =(Z?3 

<5 21 (<5 n ) _1 <5 13 = 912913 (B.4) 
Q 2 \Q XX )- X Q X2 = & , 

constant matrices. Finally, let us compute the inverse of A = Q 22 — qf 2 : 

A ab = (1 - r!)5 ab + (n - r )e ab + (r - q\ 2 ) , (B.5) 

that is, 

(a-U ^ 1 r ■ rp-r-L 1 qf 2 -r 

[A ) a b — ah + • ; € ab + 



l-ri 1-T-i 1 - 7*1 +x r (r! - ro) (1 - T-i + x r {ri - r )) 2 

(B.6) 

Now it is possible to calculate the product 

n = (Q23_g21 ( gll ) -lgl3 ) T ( g22_g21 ( gll ) -lgl2 ) -l ( g23_g21 ( gll ) -lgl3 ) _ (B 7) 

As can be easily seen the three matrices have the correct form, since they are RSB 
matrices with the same breaking point x r . Due to this fact, the result of this product 
is a constant, although very complicate, given in eq. (3.11). 
Now it remains to calculate: 

logdetfQ 33 -?/] ; (B.8) 

proceeding as in Appendix A, with y instead of q 2 2 , we get 

ylogdet[Q 33 - 2/ ] = log(l- Sl ) + -logfl + x s ^^')+- -. (B.9) 

I X s \ l-SiJ 1 - Si + x s (s 1 - s ) 

In this way we recover equation (3.10). 
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